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Abstract 

(N ■ 

We analyze the effect of finite rate feedback on CDMA (code-division multiple access) signature optimization 
and MIMO (multi-input-multi-output) beamforming vector selection. In CDMA signature optimization, for a 
particular user, the receiver selects a signature vector from a codebook to best avoid interference from other 
users, and then feeds the corresponding index back to the specified user. For MIMO beamforming vector selection, 
the receiver chooses a beamforming vector from a given codebook to maximize throughput, and feeds back the 
corresponding index to the transmitter. These two problems are dual: both can be modeled as selecting a unit norm 
r_H ■ vector from a finite size codebook to "match" a randomly generated Gaussian matrix. In signature optimization, 

HH the least match is required while the maximum match is preferred for beamforming selection. 

c/3 . Assuming that the feedback link is rate limited, our main result is an exact asymptotic performance formula 

1 ^ i ' where the length of the signature/beamforming vector, the dimensions of interference/channel matrix, and the feed- 

back rate approach infinity with constant ratios. The proof rests on a large deviation principle over a random matrix 
ensemble. Further, we show that random codebooks generated from the isotropic distribution are asymptotically 
. optimal not only on average, but also with probability one. 

■ 

o ■ 

' I. Introduction 

\Q . In a direct- sequence code-division multiple access (DS-CDMA) system, the performance is mainly 
O | limited by interference among users. We assume that the receiver (base station) has perfect information 
^ ■ of all users' signature. For a particular user, the receiver selects a signature to minimize the interference 
■ from other users, and then feeds the corresponding index to the specified user through a feedback link. 
. i-h ', Dually, consider a multi-input-multi-output (MIMO) system with beamforming vector selection. Take the 
^ ; Rayleigh fading channel model, where the channel matrix has independent and identically distributed 
c3 ' (i.i.d.) symmetric complex Gaussian entries with mean zero and unit variance (CM (0, 1)). Now assume 
that the receiver knows the channel state matrix perfectly. To aid the transmitter, the receiver chooses a 
beamforming vector from the codebook to maximize the throughput, and then feeds back the corresponding 
index to the transmitter. In both scenarios, we consider a finite feedback rate up to Rfb bits. Ideally, if the 
feedback rate is unlimited, the transmitter is able to obtain interference/channel information with arbitrary 
accuracy, but this is not practically feasible and it is essential to real systems to understand the effect of 
finite rate feedback. 

This paper is the first to rigorously obtain exact asymptotic performance formulae for both problems 
when letting the length of the signature/beamforming vector, the dimensions of interference/channel matrix, 
and the feedback rate approach infinity with constant ratios. The same set-ups had been considered 
previously in [1] and [2], in which a one-sided bound was presented (this was a lower bound on 
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the CDMA performance, and an upper bound in the case of MIMO). Our approach is fundamentally 
different. Identifying the underlying problem as a large deviation question for the connected random matrix 
ensemble, we have a unified framework which handles both CDMA and MIMO cases simultaneously^. 
Further, while [2] discusses the fact that random codebooks are asymptotically optimal on average (their 
mean performance is the best achievable performance), here we prove the stronger result that random 
codebooks are asymptotically optimal with probability oneJl 

The paper is organized as follows. After describing the system models in more detail, Section [Til] 
presents various needed facts from Random Matrix Theory. Section [IV] contains the main results. The 
basic convergence result is Theorem [T] which in turn is based on a random codebook version, Theorem 
|2l along with a separate argument that any given codebook will not asymptotically outperform its random 
counterpart. This section concludes with the almost sure optimality, Theorem HI Once again, all this is 
based on a large deviation principle for the spectrum of a Wishart type random matrix. That proof is 
found in the appendices. 

Remark 1: Our methods carry over to the problem of the average throughput of an MMSE receiver 
in CDMA systems. Each appearance of ^HH^, in say © below, is replaced by (I + ^HH^) , and the 
proof may be followed verbatim except for the few obvious (and trivial) modifications. 

II. System Model 

A. CDMA Signature Optimization 

In a sampled discrete-time symbol-synchronous DS-CDMA system with m users, the received vector 
Y can be written as 

rn 

i=i 

where Bj 6 C and Sj E C nxl are the transmitted symbol and the signature vector for user j respectively, 
and W G C nxl is the additive white Gaussian noise vector with zero mean and covariance matrix a 2 I. 
Throughout this paper, we assume that the transmitted symbols Bj's are i.i.d. CAf (0, 1) random variables. 
The signature vectors s/s satisfy sts 3 - = 1, 1 < j < m. Their length n is often referred to as processing 
gain in literature. 

This paper focuses on matched filter receiver. As already mentioned, the analysis for a MMSE receiver 
is effectively the same. With a matched filter receiver, the throughput of user 1 is 



^ 2 + Er= 2 4siSis 1 ; 

where Si = [s 2 • • -s m ]. 

The signature optimization is described as follows. Assume that the receiver has perfect knowledge of 
the s/s. It guides a particular user, say user 1, to avoid the others' interference. Here, a codebook B of 
signature vectors is declared to both the receiver and user 1. Given the other users' signatures s 2 , • ■ ■ , s m , 
the receiver selects 

Si = arg min v^SiSjv. 

'The analysis in [2] is based on extreme order statistics, applied to the case of n ] oo i.i.d. random variables with & fixed distribution. 
The laws of the underlying random variables for the problems at hand however depend on n in an essential way; attempting a proof through 
i.i.d. order statistics results in needless complications. 

2 We must add that, based on our earlier [3], the authors of [2] have gone on to refine their own estimates [4], 
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Then it feeds the corresponding index back to user 1 through a finite rate feedback link, whose rate is 
up to i?fb bits. This finite feedback rate assumption imposes a constraint on the size of the codebook, 
\B\ < 2 Rib . Therefore, the average interference for user 1 is given by 



inf E Sl 

B: |B|<2 fl fb 



min v^Si Stv 

veB 



B. MIMO Beamforming Vector Selection 



The signal model for a MIMO system with beamforming vector selection is 

Y = H+qX + W, 

where Y £ C mxl is the received signal vector, H £ C nxm is the channel state matrix, q £ C nxl is the 
beamforming vector satisfying q^q = 1, X is the transmitted signal CM (0, 1), W £ C mxl is the white 
Gaussian noise vector with mean zero and covariance a 2 I m . The dimensions n and m are the numbers 
of antennas at the transmitter and receiver. 

In the above setting, beamforming vector selection proceeds as follows. Assume that the receiver 
knows the realization of H perfectly, and feeds beamforming vector selection information back to the 
transmitter through a feedback link with rate up to fZfbbits. A codebook B containing 2 Rih many candidate 
beamforming vector is declared to both transmitter and receiver. For any H realization, the receiver selects 
the beamforming vector to maximize the throughput 

1 



q 



arg max log 
veB 



l m + — HWH 



a" 



arg max v 
veB 



1. 



-HH 



v. 



The corresponding index is fed back to the transmitter, which then employs q for transmission. The 
average received signal power is 

1 



sup 

B: \B\<2 F 



E 



H 



max v 

veB 



HIT 



n 



C. Unified Formulation 



It is difficult to quantify both the average interference in Section III-AI and the average received power in 
Section III-BI However, when n, m and Rft, approach infinity linearly with constant ratios, each converges 
to a constant. To be precise, let B = {v £ C nxl : vV = l} be a codebook. Let H £ C nxm be a random 
Gaussian matrix with i.i.d. CM (0, 1) entries. Define 



inf Eh 

B: \B\=2 R lb 



mm v 1 

veB 



■HH 1 



n 



and 



sup 

B: |B|=2 B i 

5 + 



E 



H 



max 




veB 


v« J 



(1) 



(2) 



As n, m, -Rfb — > oo with with ^ — >• ^ £ M + and ^ — >• r £ IR , we shall show that c mirijn and c max n 
converge to constants and compute their limits in Section HVl 

Remark 2: We assume that H £ C nxm has i.i.d. entries in this unified formulation while the matrix Si £ 
(Cnx(m-i) in the CDMA signature optimization is composed of independent and isotropically distributed 
columns. Notably, the asymptotic statistics of S±S\ and ^HHt are the same as ^ — > 4 £ R. The limit 
of c m i n n will gives the asymptotic average interference for user 1 in a CDMA system. 
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III. Preliminaries 

A. Asymptotic Random Matrix Theory 



The performance calculation is based on the asymptotic spectral distribution of the matrix ^HHt Let 
Ai, • • • , A n be the n singular values of ^HHt Define the empirical distribution of the singular values 

/Va(A)^|{j: A,<A}|. 

As n.m^oo with 'f -> ± G IR + , 



almost surely, where A^ = (l ± v7^) 2 an d (x) + = max (x, 0). (A good reference for this type of result 
is [5].) For later it will be useful to define 



A * ~ ^ A" if < 1 ' and A = I X ' dfiX ' 



Consider as well a linear spectral statistic 

9 



(iHHt) = I (A,) . 



If g is Lipschitz on [\ t , A + ] , then we also have that 



lim g (-HHH = / 

(n,m)^oo \m J J 



9 (A) dux 



almost surely, see for example [6] for a modern approach. 

Last, the asymptotic properties of the minimum and maximum eigenvalues will figure into our analysis. 
For any finite n, set A milli A = min A, and A max ,A = maxAj. 

l<i<n l<i<n 

Proposition 1: Let n, m — > oo linearly with 

1) A m in,n — > A t and A max ,n — > A + almost surely. 

2) All moments of A minjn and A maX) „ also converge. 

The almost sure convergence goes back to [7], [8]. The convergence of moments is implied by the 
results in [9]. A direct application of this proposition is that for \/A n C W l such that p n ,\(A n ) — > 0, 
Ea [A max ,A, A n ] — > 0; this fact will be employed repeatedly below. 

B. Isotropic Distribution 

We also bring in the isotropic distribution for 

Unxm — {U G C nxm : UtU = I m }, 

by which we mean the (left) Haar measure p of U nxm . In particular, for any set M. C U nxrn and any 
UGW nxn , p(UM)=p(M). 
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IV. Main Results 



For Vx G (A t , A + ), define 



4>x (a) 



and 



— J log (1 — a (A — x)) dfi\ if a G 
+00 otherwise 



-AT ' A+-x 



(4) 



(5) 



for any tel. Our basic convergence result for c m i nin and c maXjn reads: 

Theorem 1: Let n, m and i?fb approach infinity linearly with — — > -| G 1 
exist unique x~ G (A^, A) and x+ G (A, A + ) such that r log 2 = (0) = (0). Furthermore, 



and — ->r G IR + . There 



lim 

(n,m, _Rfb)— >oo 



x r I (3, 



and 



lim c maXj n 2> / 

(n,m, /?fb)^oo 

Remark 3: From the properties of ?/>* (0) (Proposition HI), 

nin,n -> A//3, c maXi „ -> A//3 as r | 
nin,n ► A 4 c maXin ► A + //3 as r I oo 

This is consistent with intuition: r = and r = oo representing either no, or perfect information. 
Using ideas from [10], we may also obtain fairly explicit formulas for x~ and x+. (It should be noted 
that [4] also takes on this computation, but from a different vantage point.) 



Corollary 1: Let r min = - ^ log2 
any r G M + , x~ G (A^, l) satisfies 



for V/3 < 1 and r r 



^"^^ for V/3 G R+. Then for 



x- = (1- V^) 2 + V^(l- V^) 1 ^exp(-^-rlog2) if /3 < 1 and r > r n 



and x+ G (1, A + ) satisfies 



otherwise 



= (1 + VP)* - VP (1 + VP)' ^ exp - r log2j if r > r max 
x+ = -i2-/ 3r otherwise 
Granted the existence and uniqueness of x~ and x+, which follow from basic properties of ipl (0) 
established in Proposition |4] of Appendix [A] the proof of Theorem [TJ takes the following course. First, 
by calculating the average performance of random codes, we are construct upper and lower bounds on 
limc m in jn and limc maXjn respectively. Let £> ran d be a randomly constructed codebook of i.i.d. unit-norm 
vectors from the isotropic distribution. In particular, £> ran d = {vi, • • • ,v 2 H fb }, where v fc = z k / \\z k \\, 
z k = [zk,i, • • • j z k,n] and z^i are i.i.d. CM (0, 1) for all 1 < k < 2 Rih and 1 < i < n. Define 



and 



Cmin,n,rand 



Cmax,n,rand 



Eg 



Eg 



E 



H 



min ( — HH^ | v 



E 



H 



max v 1 

veB ra nd 



HH f v 



n 



The following theorem calculates the average performance of random codes. 
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Theorem 2: As n, m, -Rfb — > oo with 



P 



and 



-Rfb 



r G 



lim c m i nnran d 

(n,m, Hfb)— >oo 



and 



x r //3 

Cmax,n,rand Ift' 



lim 

(n,m, i?fb)^oo 

Clearly, lim c minjn < lim c mininirand and lim c maXi „ > lim c maXjnirand , and the next step is to obtain 
a lower bound lim c m i n>n and and upper bound lim c max , n - Introduce the singular value decomposition, 
^Htf = UATJt where U e W nxn and A e M nxn is the diagonal matrix of eigenvalues Ai, • • • , A n . It is 
well known that U is isotropically distributed and independent with A. For any codebook B = {v 6 U nx i}, 
define 



and 



Cmin,n,A,B 



Cmax,n,A,B 



E 



u 



mm vtUdiag (A) U f v 



E 



u 



max v^Udiag (A) U'v 



(6) 



(7) 



As n, m, Rr, — > oo linearly with constant ratios i and r, Define 

Cmin,n,A,B 



Cmin.A = lim inf 



(n,m,-Rfb)-»°c B: |B|=2 fl fb 



and 



Cmax.A — lim ml C maXiTli A,B- 

(n,m,iifb)-»oo B: |B|=2 fl fb 



inf 



It is clear that c min A and c maXi \ are random variables depending on A. The following theorem provides 
bounds on c min \ and c max A, and therefore bounds on lim c minn and lim c maxn . 



Theorem 3: As n, m, -Rfb — > oo with 



and 



■Rfb 



r e 



m ^ J_ g 

n /3 ~~ n 

1) c mirij A > x~ and c maX] A < with probability 1 in A, and 

2) lim c minin > x~//3 and lim c max _ n < 

By combining the above results, Theorem \t\ is proved. 

Finally, while Theorem [2] implies that random codebooks are asymptotically optimal on average, we 
actually have the stronger result that they are asymptotically optimal with probability one. 



Theorem 4: As n, m, -Rfb — > oo with 



P 



and 



Rfb 



and 



lim a n b , 

(n,m,itfb)— >oo 



lim u n r , 

, T-. \ ' ,t strand 

(n,m,iifb)— >oo 



E 



H 



1 



E 



H 



mm -v^Htfv 

veB rand n 



max -v^HHV 

v6B rand n 



r e 1R , for any e > 



> (3 ■ x r + e 



< (3 ■ x~; 



0. 



Remark 4: The asymptotic achievable throughputs of the above CDMA and MIMO systems are 

1 



log 1 



and 



log 1 + 



a 2 + lim c minjn 
lim cw. 



respectively. These facts are direct applications of the proof of Theorem [3] 

The proofs of Theorem [2H3] occupy the next sections drV-AIHV-Cl) . The key step is a large deviation 
principle established in Theorem [5] in Appendix EJ Last, the computation in Corollary Q] is conducted in 
Appendix O 
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A. Average Performance of Random Codes 



Since the calculations of c maXiniI . an d and c m i ninjran d follow the same line, we only give the details for 
c m in,n,rand- In the following, we first prove that 

(8) 



lim c m i n n ranc j ^ x r I (3 



by Chebyshev's inequality, then show that 



lim c m i n n ran( j ^ x r I ' (3 



(9) 



by exponential change of a probability measure. 

We express c min>n)rand in a convenient form. Recall the singular value decomposition ^HH+ = UAU" 1 ". 



Cmin,ra,rand 



E 



H 



ztHHt 



m 

— E H 

n 



m 
n 



m 
n 



1 

— min 

n k || Zfc 

,t ( i 



Zfe 



Er 



Ek 



Eg 



mm 



mm 



mm 

k 



A (^HHt) z fc 



||Zfe|| 

z f fc UAUt Zfc ' 

II M 2 







2" " 


\r~\n 
l^i=l \ 


%k,i 1 


2 



where the last equality follows from the fact that z k and Uz k are statistically equal for any given n x n 
unitary matrix U. Let Y k)i = \Z kyi \ . Then Y k /s (1 < k < 2 a and 1 < i < n) are i.i.d. random 
variables with probability measure dfx y = e~ v dy. Note that for a given A vector, the random variables 
J^" =1 Ajlfc j/ J^™ =1 Yfcj's (k = 1, ■ ■ • ,2 Rfb ) are conditional independent (conditioned on A). Define the 
corresponding conditional probability measure 



< X 



n 

/in,Y ( ^ (A, - X) Yi < 



(10) 



t=i 



A . 



Then 



Thus 



and 



Er 



En , , i2 
j'=1 

mm — — 2 

^ X^i=l Aj 1 | 



l-(l-Mn,Y (X|A)) 



2 fl fb 



>min,A 



+ 



^1 - Mn,Y (^|A)) 2 ^ (is 



mm (n, mj 

Cmin,n,rand -t-'A 

n 



*min,A 



'1 - /Vy (^l^)) 2 ^ ^£ 



(11) 



In order to prove the bounds in ® and ©, we need the large deviations of /i ni Y (^|A) in Theorem [5] 
Specifically, as n, m — ► oo with ^ — > ^ for Vx £ (A^T, A) 



lim -log/^ iY (s| A) = -ip* x (0) 

(n,m)— >oo Tl 



(12) 



almost surely in A. 



7 



1 ) Proof of the Lower Bound: 

We prove the lower bound in ©. Take an e > small enough such that A^ < x~ — e. Since (0) > 

ip* x . (0) (Proposition 1£4)), there exists a 6 e > s.t. ^* x -_ t (0) > (0) + 25 e and A t ~ + S e < x~ - e < 
A + — 8 f . Define 



.4 



A : 



1 



n 



logyU„, Y (x; - e\ A) + ^*__ e (0) < <J ej 
|A m i n ,A — A t I < 8 e , |A maX]A — A + | < 5 e } 



According to the large deviation principle in (fT2l) and the almost sure convergence of A min n and A max n 
(Proposition [T]), lim fJ> n ,\{An,\) — 1- Note that on the set A n \ 



, -n f „ (0)-5 E -» V*_(0)+-5< 

A*n,v (a r - e A) < e V =%■ -« J < e 



When n is sufficiently large, on the set A n X 

(l - /"n,Y (^r _ e | ^)) 



2 fl fb 



> exp { 2 Rtb ■ log I 1 - e 



n V*_(0)+<5, 



exp < e 



n(r log 2+o(l)) 



-n U*_(0)+«5 

-e V / (1 +o (1)) 



= exp{-e- n(<5e -° (1)) (l+o(l))} 
> 1 -5,. 



Therefore, when n is large enough, 

> E ; 

> E; 

> Ej 



^max, A 




(1 




min, A 










(1 


J\t+Se 




/•Xr — £ 






(1 


J\t+S e 










(1 






- 5ef (X 


r 



y (x\ A)) 2 fb d: 
1 - A*n,Y (a; I A)) 2 fb da;, A niA 
(l - A*n,Y (av - e| A)) 2 ^ dx, A niA 
1 - 5 e ) , A n , A 



where the last inequality follows from the fact that /i n A (Ai,a) > 1 — <5 e for sufficiently large n. Decrease 
5 e > to zero and then let e > approach zero. We have 



E 3 



[1 - AVY (x\ A)) 2 ^ Gb 



^min,. 



> a; r - A t . 



Substitute it into (fTTI) and note that E A [A min A ] — > X t (Proposition [T]). The lower bound © is proved. 
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2) Proof of the Upper Bound: 

Now we prove the upper bound in ©. 

Take an e > small enough such that x~ + e < A. Since ip*_ (0) > ip*_ e (0) (Proposition HJ4)), there 
exists a 5 £ > s.t. (0) > V*- , (0) + 2<5 e and + 5 e < x~ + e < — <J e . Define 



5 



n,A 



A : 



-]ogfi n> -Y(x- + e\\)+il>* (0) 



n 



A 



min,A 



X t I < S e , |A max ,A — A + | < 5 e } . 



Then lim fj, n> \ (B n< \) = 1. Note that on the set B n< \ 

(n,m)— >oo 



. -nU* (0)+i« -n V*-(0)-«, 

A^n,Y (x r + e| A) > e V ^ +£ / > e 



When 7i is sufficiently large, on the set B n \ 



,2 K fb 



(l - /i„, ;Y (a: P + e| A))' 
< cxp ^ 2 Bfb log f 1 — e ~ n V*r (0) ~* e ) 



Note that 



exp < e 



n(r log 2+o(l)) 



-e V »r y (l + o(l)) 



= exp{-e n(5E+o(1)) (l + o(l))} 
<<L. 



< E; 



max. A 



(1 — /U n> Y (#| A)) 2 ft dx 



■^min, A 

^max.A 



(1 - AVy (a; I X)) 2Rth dx, B n>x 



min, A 





P ^max,A 


+ E A 


/ 1-dx, K,x 



The first term is upper bounded by 

" ^max,A 



E, 



< E, 



(1 - yUn.v (a; | A)) 2flfb dx, B n \ 

A++<5 E 



^min,A 

Xr+e 



ldx + 

< (x~ + e - A~ + 6 e ) /i„,A {B n ,\ 



2 R a> 



(1 - A«n,Y (z| A)) dx, 5 njA 



+ E ; 



f 2 fl fb 

/ (l - A*n,Y (^V + e | <*)) ^ ^n,A 



< (ar p + e - A t + 6 e ) // n ,A (-B n , A ) + (A + + 5 e - x r - e) 5 e • /i n , A (-B njA ) 

< [(x~ + e - A~ + <J e ) + (A + + 5 e - re" - e) S e ] (1 - <J e ) 



(13) 
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when n is sufficiently large. The second term in (TT3T ) can be upper bounded by 



E, 



1 • dx, B° x 



= E A [A maX) A, B^\] — E x [A m i n ,Aj Bn,\] 

< Ea [A maXi A, B^\\ + Ea [A mirij A, -B«,a] 
<2<5 e , 

for sufficiently large n, where the last inequality is implied by Proposition [T] Let 5 t j. and then e J, 0. 



lim Ea 

(n,m)— >oo 



^min 



< x„ — A 



t ■ 



and therefore the upper bound ® is proved. 



B. Uniform Bounds for Arbitrary Codebooks 

Here we prove Theorem |3] for which the following fact is important. Let U G U nxn be isotropically 
distributed, then for any given v G lA nx \ and A, U^v G lA nx \ is isotropically distributed and 

AVu (v^AUV < a; | v, A) = // niY A) , 

where /i nY (ac| A) is defined in flU. Furthermore, as A mirii A < A maXiA , /Vy (A mixi ,A| A) = 0, /i nY ( A max ,A| A) 
I, and there exists a unique x p G (A mirij A, A maXj A) such that yU n Y (x p \ A) = p. 

Recall the definitions in © and ©. For any given n G N, singular value vector A and codebook £>, 
the following lemma provides lower and upper bounds on c m - m:rij x,B and c maXjni A,B. 

Lemma 1: Let A be such that A min A < A max A- Then 



inf c minjni A,B > 2 fb / x • d/z n , Y (x| A) 

B: |fl|=2 fl fb Jx . 

1 1 ■ A min, A 



and 



SUp C maXjni A,B 



< 2^ 



B:|B|=2«fb _ A 



x ■ dfj, n< Y (x\ A) 



where /i nY (ac-J A) = 2"^ and /i nY (x+ A | A) = 1 - 2- R ^. 

Proof: We give the details behind the lower bound on c m \^ n ^x,B omitting those for c mSkXjrii x,B- For 
any given B such that \B\ = 2 Rlh , 

Un tt mmv f UAU f v < x \\,B\ 

' \veB J 

= n |u G U nxn : viUAU f v fc = mmv^AU^ < x\ 

= minv^UAU^v < x > 
k=i ^ ^ veB > 

2«fb 

< ^2 ^ n > u { u G Wnxn : v i uAut v fc ^ x a, Vfcj 



A, <B 
A,£ 



2 i? >„, Y (x|A). 
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Thus, 



Cmin,n,A,B = / X ■ d/i n ,U (x\ A, £) 

\nin,A 

= A maXj A - / /in,u (x| A, B) dx 

J ^min,A 
P ^rriax,A 

> A max , A - / min (2 i?fb /i„ iY (x| A) , l) dx 

J ^miruA 

x • dmin (2 jRfb /i„ )Y (x\ A) , l) 

^min,A 



f X n,\ 

2 R(b / x • d/j, n> Y (x\X) . 



The proof is finished. ■ 
The next lemma shows that x^ x converge A-almost surely to the advertised constants. 
Lemma 2: As n.m.R^ — > oo linearly with — — > /3 G R + and ^ — >■ r G M + , lim x~ x = x~ 

(n,m,Rft,)—roo ' 

and lim x^ x = x t almost surely in A. 

(n,m, _Rfb)— »oo ' 

Proof: Take the case of A , that for x+ A being much the same. Note that ip* (0) monotone decreases 

as x increases in ^— ^j^- , oj (Proposition 0J4)). For Ve > small enough such that < x~ — e < 

x~ + e < A, there exists a 5 e > such that V>*-_ e (0) - 5 e > r log 2 = (0) > ip* x - +e (0) + 8 e . According 
to the large deviation principle in (fT2l) . 

lim -log// n>Y (a^T - el A) < - (rlog2 + 5 e ) 

(n,m)— >oo/Z 

and 

lim — log /i„ Y (a^r + el A) > — (r log 2 — 5 e ) 

(n,m)^oon 

almost surely in A. By the definition of x~ x , 

lim — log/i n>v (x~ J A) == lim — log 2~~ Rih = — r log 2. 

(n,m,Rfb)^ooTi ' ' (n,m,.Rfb)— >oo Ti 

Therefore, x~ — e < lim x~ A < x~ + e almost surely. To finish, let e J. 0. ■ 

Now we are ready to prove Theorem [3] 

Proof: [Proof of Theorem Once again, we only give the details for c m i n . 
1) Take an e > small enough such that A^T < x~ - 2e. Since -0*__ (0) > ip*^ (0), 35 e > s.t. 
ip* x ._ e (0) > V*_ (0) + 25 e . Define a set 

A n , x = {A : |A min ,A - A^| < e, -x~\ < e 

- log /i n , Y (x~ - el A) + ip* (0) < tf, 
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According to Proposition Q3 Lemma [2] and (fl~2l) . // niA (A nj \) { - n ' r H^L f cc ' \ Q n fa Q set A n> \, when n is 
sufficiently large, 

2^ / x-d//„, Y (^| A) 



X n,X 



■ min (2 Rfb /in,Y (z| A) , l) dx 

J -^min,A 

> (x--e) - 2^/x^y (x; - e\ A) 



Ida; 



^min,. 



'x,. — e 



> x r — 3e — e 

> x" - 4e. 



-n(<5 E +o(l)) 



(x r - e - A t + e) 



Now take e | yielding part (1) of Theorem [3] 
2) For any e > 0, define 



From Part (1), /i njA (£ nA 



B n ,\ — { A : inf Cmin n \,B > 
B: \B\=2 R fh 



1. On the set B n \, for sufficiently large n, 



inf E A 

B: |B|=2 fl fb 



mmv 



> E) 



inf Eu 

B: |B|=2 fl fb 



minv^UAU^v 



inf c mi n ini A,B, B nX 

B: \B\=2 R Cb 



> ( x - - e) (1 - e) . 
Again, e can now be taken to zero to complete the proof. 



C. Asymptotic Optimality of the Random Codebooks 

At last we come to the proof of Theorem HI As before, it is enough to focus on the x~ case. 

While the proof of Theorem [2] rests on the probability measure /i n ,,B rand H A, U), we now require the 
measure Hn^u (-| -Brand)- These two measures are connected by the joint measure /i n ,B rand ,A,u : for any 
measurable set A c {£> ran d} x {A} x {U}, 

AVSrandAU = E A;U [/i n ,B rand (^| A, U)] 

= E Brand K^U (^1 #rand)] • 

We first show that for any e > 0, 

lim fin,B iand ,\,v ( min v+UAU+v < x~ + e J = 1. (14) 

(n,m,Rfb)-+oo WeSfand / 
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Note that (0) < rlog2. There exists a S e > s.t. (0) + 2<5 e < r log 2. Let 

1 



.4 



n,A 



A : 



n 



logn n> - Y (x- + e\\)+ip* (0) 



, . (n,m)— >oo i i . 

Then [i n> \ {A nt \) — ► 1 by (I12J) . Thus, as n is large enough, 



/^n,s rand ,A,u min v T Av < x r + e 

. vee rand 



Ea,u 
Ea,u 



/VB ri 



in v^Av < x„ + e 



mm 

VGB rand 



A,U 



1 - (l - fi rhY (x r + e| A)) 



2«fb 



> 1 — exp 



_ e n(Ho g2+ o(l)) e -<^_ +E (0) + , £+ o(l)) + o 



Mn,A (Ai,a) 



> (1 - <J e ) (1 - <J e ) . 



This is d) once 5 £ J. 0. 

Next we have the following fact. For Ve > 0, let 5 e > be such that (A + + e) 5 e < |. Define a set 



B n = I 23 rand : /i n ,A,u ( min ytUAUV < x r + - 

B ran d 4 



#rand I > 1 ~ S f > . 



Then 



lim /in,B rand (S n ) = 1. 



This fact can be proved by contradiction. If it were not true there would exist a subsequence rij such that 

A 4 ",, ) < 1 - f far some t > 0, and 



!im /in,Brand,A,u ( min v f Av < x r + e J 

n,m,_Rfbj^OO \VGi5rand / 

< lim 1 • /inland i B n 3 ) + (1 - Se) /^,B rand ( 
(n,m,Rft,)— too \ 

< 1 



which contradicts (PT41) . 
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Now on the set B n , if n is large enough, 



where 



Ea,tj 

(a) 



mm v+UAU+v 

veB rand 



rand 



^ ( x r + i) Vn,\,u ( min v+UAU+v < 



^rand 
•t 



Amax.A, A maXj A - A + < e, min v T UAU T v > x r 

v6B rand 



max, A; A max .\ 



A + | > e, min v^UAUW > 



•37 r' 



veB„ 



min v^UAU^v > a; r H — 

ve B ran d ' 4 



< (x~ + |) • 1 + (A+ + e) /va,u f 
+ Ea,u [A 

max, A- ''max. 

a — A + | > e| £> ran d] 
(A+ + e) 6 e + E x [X 

max, A; K v max,A -A+| >e] 



Brand 
Brand 
Brand 



( b ) / e\ e e 



(a) follows from the fact that min v^UAU^v < A max> A, and 

veB rand 

(b) follows from the fact that E A [A maXj A, |A max A — A + | > e] < ■§ for sufficiently large n. 
Therefore, Theorem |4] is proved. 



V. Simulations 

Fig Q] and [2] give simulation results for several CDMA systems and MIMO systems respectively. In 
both figures, the x axis is the normalized feedback rate r = -^ k . The y axis in Fig \T\ is the c min n and 
that in Fig [2] is the c maXin . The dashed lines with x markers are for random codebooks while the solid 
lines with plus markers are for well designed codebooks, which are numerically generated by the criterion 
of maximizing the minimum chordal distance of the codebook. The solid lines without any markers are 
the asymptotic performance by Corollary [IJ Simulations show that as n, m, i?fb increase linearly, the 
performance (c min n and c max n ) will get closer to the asymptotic one. Although random codebooks are 
not optimal for finite dimensional systems, as n, m, increase linearly, the difference between random 
codebooks and well-designed codebooks decreases. 



VI. Conclusion 

In this paper, we analyze the effect of finite rate feedback on CDMA signature optimization and 
MIMO beamforming vector selection. The main results are the exact asymptotic performance formulae. 
In addition, we prove that random codebooks are asymptotically optimal not only on average but also with 
probability one. The proofs rest on a large deviation principle derived over a random matrix ensemble. 



Appendix 

A. Properties of Rate Functions 

Let Y be a non-negative random variable with probability measure dfi y = e~ y dy for y £ [0, +oo). Let 
Y M be a non-negative random variable with probability measure 

dPy,M={ n " Y[ °' M] 1 ■ (15) 

otherwise 
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Fig. 1. c„ 



(a) (5 = 1/2 



(b) P = 2 




— Good Codebooks ; 1"=' 
- Random Codebooks 

— Asymptotic c 




1 1.5 



Fig. 2. c 



(a) = 1/2 



max . a 



(b) P = 2 



Let djj,\ be ([3]). Define the moment generating functions 



i>x,M («) 



J logEy [e a{x ~ x)Y , \Y\<M]dfi> 



4> x (a) = lim if} x M (a) 

M— >oo 



and 



^,y m (a) 4 | logEy M [ e °(>-)^] 



(16) 
(17) 

(18) 



Clearly, ^x,y M (a) = Vx,m (a) — log /iy [0, M\ . Proposition (23) shows that ip x (a) has the form ©. 
Furthermore, for Vt G R, define the rate functions 



ip x (t) = sup [at - ip x (a)] , 



and 



V£,y M (*) - sup [at - ip xXM (a)} . 



(19) 



(20) 



aeif 



In the following, we shall discuss the properties of these moment generating functions and rate functions. 



15 



Proposition 2: (Properties of tp (-)'s) 

1) For Va G K, logEy [e a ^ A ~ x ^ y , |Y| < M] is a Lipschitz function on any compact set of A G 

2) V'x.m («) is monotonically increasing with M, and 

tp x (a) = lim i^ xM (a) 

M— >oo 



— J log (1 + a (x — A)) (i/iA if a G 
+oo otherwise 



3) ip x ,M («) and V'x.yM ( a ) ^ strictly convex functions of « £ 1, and ip x (a) is strictly convex on 

4) Let x G (A t ,A + ). For Vt < A — x, if M is large enough, there exists an a G (— oo,0) such 
that tp' x M (a) = ip' x Ym («) = t. Similarly, for V£ > A — x, if M is large enough, there exists an 
a G (0,'+oo) such that («) = ^,y M («) = t- 

Proof: 

1) First note with the restriction {\Y\ < M}, both logEy [ e a(A_:r)y , |Y| < M] and V*,m (a) are well 
defined. Let f M (A) = log f Q M e^^-^^e^dy. Then 

aye a ^ye-ydy 
Jo e a{ x)y e~ y dy 

Since both e a ( x - x )v-v an( j a ye a( ~ x ~ x ^ y ~ y are continuous functions of A and y on the compact set 
Ax x [0, M\, and there exist positive constants a > and 6 > such that 

e a(A-x)j/ e -y > a? and | a2/e a(A-x)»-»| < ft 

on that set. Thus, \f' M (A)| < - < oo and so f M (A) is Lipschitz on A\. 

2) The monotonicity of ip Xj M («) is obvious, as is the identification of the limit ip Xj M («) presented in 
Part (3). 

3) The convexity of logarithmic moment generating functions is a standard fact, see for example 
Chapter 2 of [11]. 

4) It is clear that ip' x M (a) = tp' x Ym (a), and we need only calculate the former. 
To simplify the notation, denote z — 1 — a (A — x). Then 

ip x ,M (a) = / log I J dux 

and 

, , fl- (1 + Mz)e- Mz . , 

€,M («) = J z{l _ e -L z) ( A " *) ■ d ^ ( 21 ) 

If a = 0, then z = 1 and 

1 - (1 + M) e~ M 

e~ 

It is clear that 



C«(°)= V "m (*-*)■ 



VIm (o) ^^-^i 00 A - x. 



Now we evaluate V^m (±00) • Note that 

z = 1 — a (A — x) 



-00 on A G [\ t , 
+00 on A G (x, A + ] 
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We evaluate the integrand in (12TI) and obtain that 

1 - (1 + Mz) e~ Mz a ^_oo (M(\-x) onA6[A t -,i) 

z(l-e~ Mz ) [ X) ~~ ' |0 onAG(x,A+] 



and 



Therefore, 



and 



1 - (1 + Mz) e~ Mz _ a^+oc jO on A G [AT, x) 

z(l-e- Mz ) [ X) ^ \M(X-x) onA6(x,A + ] 



,/ / . \ M->+co 



which prove Part (5). 

■ 

Proposition 3: (Properties of 4>* xYm (')) 

1) r x , YM (t) > o. 

2) For Vx G (X t , A + ) and Vt G R, if M is large enough, there exists a 7 G R such that ^ Ym (7) — * 
and ip*y M (t) = lt — i>x,Y M (7)- More specifically, 7 < when t < A — x, and 7 > when t > X — x 

3) Consider an x G (A^, A + ) and Wt 1 ,t 2 G R. For a sufficiently large M, let ^y (ti) and V£,y M (^2) 
be achieved at a G R and /3 G R respectively. Then 

r x , YM (t2) - r X) y M (h) < p (t2 - to , 

where the equality holds if and only if t\ = t 2 . 
Proof: 

1) It is from the fact that at — i) x y M ( a )L=o = 0- 

2) This part follows directly from Proposition [2[5) and the strict convexity of ip* Y (t) (Proposition 

my). 

3) Let a G R and 7 G R be such that ip' XjYu ( a ) = *i an d V4,y M (t) = fe- Clearly, r/£y (ti) = 
o*i - ^,y M («) and C,r M fcO = 7^2 - ^x,y m (l)- If h i 1 *2. tnen « 7^ 7 and 

^x,y M (*2) - V£,y m = 7*2 - ^x,Y M (7) - (o*i ~ ^x,Y M («)) 

= 7 (t 2 - *i) + *i (7 - «) - [Vfe.Yw (7) - A,y m (a)] 

= 7 {h ~ *i) + h (7 - a) - ij' x<YM (0 (7 - a) 

= 7(t2-*l) + (*l-<y M (0) (7-«) 
(6) 

< 7 (*2 - *l) , 

where (a) is from the mean value theorem for some £ G (min (a, 7) , max (a, 7)), and (6) follows 
from the strict convexity of i/) x ,y m (a). 

U 

Proposition 4: (Properties of ip* (0)) 

1) r x (t)>o. 

2) Let x G (Xt, A+). For \/t < X - x, 

vp x (t) = sup at - i/j x (a) . 
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For Vt > A - x, 

ip* (t) = sup at - ip x (a) . 

3) r x (o) = o. 

4) ip* (0) monotonically decreases on x E (A t , A) and monotonically increases on i e (A, A + ). 

5) As a; | A t " or x | A+, ^* (0) -> +oo. 

6) For Vr e M + , there are unique E (A^,A) and x+ e (A, A + ) such that rlog2 = (0) 
Proof: 

1) It is from the fact that at — ip x (a)\ a=0 = 0. 

2) We only prove it for the case that t < A — x, as t > A — x is the dual case. 
It is clear that 

ip* x (t) = sup at — ip x (a) 



t-A, 'X+-x 



for ^ (a) = +oo if a ^ 



c-A7 ' A+-x 



Now for any a > 0, 

<at- Je y [loge a(A ^ )y ] rf/i A 
(t-(\-x)) 



= a 
< 0. 



x— X 



Note that *0* (t) > 0, the sup is on a E 

a E x \- i 0^, it is sufficient to have the sup on a E ^— ^j^, , oj. 



, . Since log (1 + a (x — A)) is continuous on 



3) ipl (0) > by Part (1). However, ^ (a) > - log (l + a (A - A)) = and ^* (i) = -inf ^ («) < 

0. We have that V>j (0) = 0. 

4) If A t ~ < y < x < A, 



v>: (o) 



sup / log(l + a(y - \))dnx 

1 n\ 



(a) 

> 



sup / log(l + - X))dfj,x 

1 ^ 



(6) 

> 



sup / log (1 + a (x — A)) d/ix 



a6 

= € (0) , 

where (a) follows from shrinking the range of a, and (6) is from the facts that y — A < x — A and 
a < 0. 

Similarly, if A < x < y < A+, V* (0) > ^* (0). 
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5) In order to prove that x [ X t implies i/j* (0) t oo, let x n j X t and a n = — -, — ^— y G ( ). 

2\x n — \ t j \ x„ — X t J 

Then ip Xn (a n ) is well defined for all n. 

c(°)>^K)=/i° g ( ^% ( t:!^ Ar )^- 

We shall show that ij;* (a n ) j oo. 
When /? < 1 (A t ~ = A " > 0), 

ipx n (<*») = y log (x n - A^ + A - A t ~) rf/i A - log 2 - log (ar n - Ajr) . 

Since for e > 0, IJJ x a+1 log (x) g?x| < oo for Va > —1, and we have | J log (A — \~) d/J,\\ < oo, it 
holds 

ifrxn ( a n) > / log (A - A t ~) dux - log (x n -Xt) - const. 
When > 1 (A t ~ = 0, A" > 0), 



n— >oo 

— >■ +oo. 



r-1 1 1 /* + / ^+A \ (A-A-) 1/2 (A+-A)^ A 
^„ (<*„) = log - + - / log — — dX 



t 2 r 7a- V 2x„ / 27rA 



1 1, / x 1 /" A+ i / n (A-A-) 1/2 (A+-A)5 „ 
log _ log (2 Xn ) + _ / log(x n + A)^ 



r °2 r ~°^~»' r y A _ -v 2?rA 

>■ OO. 

Similarly, let x n f A + and a n = 2 (\+- x ) e A+-g ) ' ^ can ^ e P rove( l tnat as n ~^ 00 > 
oo and therefore ^* (0) — > oo. 
6) This follows from Prop. [3] (5) and (6). 



a, 



5. Large Deviation Principles 

This section is devoted to prove the following large deviation principle for fJ, n> Y- 

. For any t < X — x, 



Theorem 5: Let n, m — ► oo with — — ► -= e 

n p 



lim -log/x n>Y 

(n,m)—> oo 77, 



V n ' 

\ i=i 



almost surely (in A). Similarly, for any t > A — x, 



lim -log/i n>Y 

(n,m)— >oo ?7, 



x) K- > t 



o<0 



-ifr* (t) = —sup [at — ip x (a)] 

o>0 



almost surely (in A). 

The proof of Theorem [5] rests on another large deviation principle presented in below. Recall the 

truncated variable Y M defined in (TT5T ), its moment generating function 4> x ,y m ( a ) * n GU) an( l i ts rate 
function ip* Ym (t) in (|20)) . 



Theorem 6: Let n, m — > oo with 



i 



lim -log/i niYj , 

(n,m)— >oo fl 



\ i=l 



n ^~ 

x) Y Md < t 



. For any t < X — x and large enough M, 
A 



V£,y M (*) = - SU P [«* - ^,Ym («)] 

»<0 
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almost surely (in A). Similarly, for any t > A — x and sufficiently large M, 

lim - log// n> Y M [ - V (Ai - a;) >i A] = -VC,y M (*) = ~ SU P [ ai - ^,y M («)] 

(n,m)^oon \ n ^— f / Q >o 

almost surely (in A). 

The proof of Theorem [6] is given in Appendix IB.21 Based on Theorem [6l Theorem |5] is proved in 
Appendix IB.U 

1) Proof of Theorem\5\ In the following, we only prove Theorem [6] for t < A — x. The t > A — x case 
is just the dual case. 

An upper bound is constructed by Chebyshev inequality. Take any a 6 f~ ~^= > Oj > 



lim — 

(n,m)— >oo7l 



v,; - X) K < t 



-log/i„, Y ( -Y^CAi 
\ i=i 

< lim -log{e- na *E Y [e"^^"^ Al) 

(n,m)— >oo7l I L J J 

= - | ^ - y logEy [ e a ( A -^ y ] d/i A j 



almost surely (in A), where the last equality follows from the fact that Ey \e a{ ~ x z ^ y ] is Lipschitz on 
[A t ",A + ] for Wa e (—^=r,0\. Therefore, 



lim — 

(n,m)^oo Tl 



-log/i„, Y ( -Y2(Ai 



< 



a;) < t 
sup {at — ip x (a)} = —i/;* (t) 



(22) 



at 



almost surely (in A), where the last equality follows from Proposition 0J2). 
A lower bound is obtained from Theorem [61 



lim -log /i n , Y 

(n,m)—>oo Tl 



> lim -log/i„ iY 

(n,m)— >oofl 



x) Y < t 



lim — 

(n,m)— +oo Ti 



1 / 1 - 

-iog/i n ,Y M -y,(Ai 

\ i=i 



x)Yi<t, ntiWl <M} 

.r) V, < / A | -log/xy [0,M] 



= -^,y M (t)-log//y [0,M], 
almost surely in A. where the last equality follows from Theorem [61 Note that ip x (a) = lim ip X Y M (&), 
r x (t) = lim r x ,y M (t) and lim lo gy uy [0,M] = 0. 



(n 



lim -log/x n ,Y ( ~y^X\ ~x)Yi < t A ) 



> -vc (t) 



almost surely in A, which proves Theorem |5] 
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2) Proof of Theorem® The proof of this theorem follows the same line in that of Gartner-Ellis Theorem 
[11]. In the following, we only gives the details for t < A — x, as the t > X — x case is just the dual case. 

Similar to the upper bound in (1221) . by Chebyshev's inequality and maximization over a G R~, we have 
the upper bound 



lim - logyU n .v M [ - (A, - x) Y M ,i < t A ) 



< -sup [at - 4> xXm (a)} 

almost surely in A, where the last equality follows from Proposition [3^2). 
Now we prove the lower bound 



lim - logyU nj Y M [ - (A» - x) Y M ,i <t A 

(n,m)^ooTl \ 71 — / 



> ~<,YU (*) 



(23) 



almost surely in A. This lower bound rests on the fact (will be proved later) that for any sGR and e > 0, 



lim 

(n,m)— >oo7l 



1 f 1 U 

\ i=i 



A > -VI y M («) 



a?) ijif,. G (s - e, s + e 

almost surely in A. Note that for Vs < t, there exists an e > such that (s — e, s + e) C (— oo, t) and 

A 



(24) 



(n,m)— +oo 72 



1 / 1 

lim - log /i„,Y M - V] (Aj - x) Y M i < t 

\ i=l 
1 / 1 " 

- log fj, n> Y M I - (Aj - x) Fjvf,j G (s - e, s + e) 



> lim — 

almost surely in A. Take s 1 1. ip* Ym (s) — > y M The lower bound (|23l) is then proved. 

The inequality (1241) is proved by exponential change of measure. Let 7 6 I such that ift* y m ( s ) = 
7-s — ^x,y m (7) 5 or equivalently, ip' xYM (7) — s - Such 7 exists according to Proposition \^2). Note that 
^/•Vyw = nr=i d/j<y Mi - Define a new probability measure (exponential change of d/x n ,y m ) 



,yj\/ 



E Ym [eE^iMAi-^y^] 

e Ei=l 7(A*-*)W 



dfi r 



Since J dji n ^ M = 1, /t n ,y M is a well defined probability measure. Let 



n,yAf • 



.4 



«,y 



{n 1 n 

(yi, ■■■,y n ): ye[[[o^]. 
i=l i=l 



x) j/j € (s - e, s + e) 
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Then 



^ log/i n ,Y M (A» - sc) Fj|f,i e (s - e, s + e) \j 

= - log / G^n,y M 



-log 

n 



dUn 



- i oge - n { 7s -" Er = ilogE ^ [ e7(Ai_ * )yM M} 



n 



+ -lo§ 

n 



-™7[^Er=i(^-^)j/i- s ]^ 



^ " - ^ E lo S [e^-^- |A]J + i log ^e-»W jf d/v y 

= - 17« - - ElogEy A/ [ e ^-)yu| A ] 1 - | 7 e| + -log^ )YM (A«rl A) . 
I n i=i J 

Note that lim ± J]"=i lo g E Y Af [e 7(Al_:r)yM I A] = Vx,r M (7) a l most surely in A. (O is true if 

(ra,m)— »oo 



lim - log /i„,Y M ( A n , y I A) = 

(n,m)—f 00 72. 



(25) 



almost surely in A. 

In order to prove ((2~5l) . note that 



A*n,Y M ( Ai.yl A) — 1 — /i 



- x) yi < s - e 



\ i=i 

n > Y M - X ) Vi > S + e A^ 



We upper bound fi n ,Y M ( £ S"=i (A» - ar) 2/< < s - e| A) and /i n ,Y M ( \ YJLi (K - x) Ui > s + e\ \) re- 
spectively. Note that 

lim I log / e a ^- x ^djl n , yM 

(n,mj— >oo Tl J 

= lim -log f e {a+ ^^- x)y *dfi nyM — — log Ey,, \e<^-^ YM A Al 
(n,m)^oo |_n y ' n 

= iPx,y m (a + 7) - ^,y M (7) 
almost surely in A. Define rj> XtYM (a) = ip xXM (a + j)-ip x ,Y M (7) and i>ly M is) = sup as - Tp x> y M (a) . 

Q, L 

Since ip x ,Y M («) is strictly convex (Proposition [2t4)), ip x ,Y M (a) is strictly convex. Note that ip' x Ym (7) = s 
as M is sufficiently large. For large enough M, 

> s if a > 

Cym («) = ^,n f (« + 7) { = s if a = 

< s if a < 
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Therefore, ip^Y M ( s ~ e ) 1S ac hieved at an < and 

$1,Y U ( S ~ e ) = a *-£ ( s - e ) - $*,Yu i a s-e) 

= (a s - e + 7) (s - e) - i) x y M + 7) - 7s + ip x> y M (7) + 7c 
= 7e - fey M (s) - V x y M (s - e)] 



> 0, 



where (a) is from the fact that ip' x Y (a t - e + 7) = t — e, and (6) follows from Proposition's). Similarly, 
■0* y M is + e) is achieved at an a s+e > and ip* (ts + e) > 0. Now, by Chebyshev's inequality, 



and 



lim - log /i„.Y M ( - ~ x ) Ym,% <s-e 



-^1,y m (« - e) < 0, 



lim - log/i n ,Y M ( - V (Ai - a:) iV,< < s - e A J = -^,y M ( s + e ) < °- 

(n,m)— >ooTi y 71 — y 

almost surely in A. Take a b > such that (t — e) > b and ■?/>* (i + e) > b. Then, 



lim -log/2 n> Y M (Awl A) 

(n,m)— >oo n 



> lim - log (1 - 2e-" b(1+o(1)) ) = 0, 



(n,m)— >oo7i 

which is exactly (1251) . 

C. Proof of Corollary [7J 

The following lemma, proved in [10], is essential to our derivation in Corollary [Q 
Lemma 3: For \/z G C\ [A - , A + ], 



CO 



ZX -f,(X)dX=^P-, (26) 



o 1 + zX p Az(3 



and 



log (1 + zX) f p (A) dA = log (l + z - l -T (z, (3)^j + ± log + */3 - \t (z, - (27) 

where 

^(z,/3)^ ((l + A^) 1/2 -(l + A+z) 1/2 ) . 
The basic step uses (1261) to identify the a* at which ip* (0) is achieved. 

Proposition 5: Let x G (A^, A + ) . Let a* be such that ip* x (0) = / log (1 + a* (x — A)) Then 



a 



^ if x > 1 + VP, 

if x< 1- v73and/?< 1, 
4 2= ^ otherwise. 



Proof: Since —ip x (a) = J log (1 + a (x — A)) dfi\ is concave on a G > \+~_ x J (Proposition 

124)), a* can be found by evaluating — ^ (a). 
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We computes —ip' x (a) for any a/-^, 

x — A 



1 + a (x — A) 

1 

a 



ax 1 
+ 



l+ax ' 



1 + ax 1 + aa; J I — 

1 ax F{-T^iP) 
a l + ax 



TV— A 



where the last line follows from (|26l ). 

By evaluating ■?// (a) at the boundary points a 
satisfies 

a 



\+-x 



and a 



x—X. 



(28) 



it can be verified that a* 



i 



a 



if x < 1 - and /3 < 1 
1 if x > 1 + v 7 ^ 



\+-x 

ip' x (a*) = otherwise 

We shall find a E f — ^j^- , sucn tnat V'i ( a ) = 0- Suppose that a ^ —\ where ip' x (a) can be 

computed from <f28]). < (a) = implies T (3) = Let y = a(3. Then 

4a 2 (3x 2 



l + y-a(l + /3)-2y / ((l + z/ )-«(l + /?)) 2 -4« 2 /?) . 



1+y l+y 
Elementary simplification gives a quadratic equation 

(a(3 - 1) y 2 + (a + a/3 - 1) y + a = 0, 

whose two roots yi — — 1 and y 2 = 1 J^, i3 - Since we have assumed that a ^ — |, the only possible root is 
y 2 = j^-g . It is then clear that 



a 



lx-1 

P x 



(29) 



Finally, we shall discuss the case that a = —K ip' x (— = implies that (3 < 1 and x G (l — ^/A !)■ 
Note that 







x — A 



1 + H) (* " ^ 
d//A - 1 



A 



1-/3 



1=1-/3 



-7^5 = — -. The case a 

l— p x 



■- is a special case of 



We obtain that x — 1 — (3. However, 

Now for any given r e M + , we compute x~ and x+. Note that ipl (0) = — ift x (a*). By Proposition [5] 
and (|27T) . we are able to solve the equation rlog2 = —ip x (a*). The results are presented in Corollary [Q 
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